Integral-type liquid crystal panel with image sensor function

ABSTRACT

A display device using a novel semiconductor device, which includes a pixel matrix, an image sensor, and a peripheral circuit for driving those, that is, which has both a camera function and a display function, and is made intelligent, is provided and a method of manufacturing the same is also provided. One pixel includes a semiconductor device for display and a semiconductor for light reception, that is, one pixel includes semiconductor devices (insulated gate-type field effect semiconductor device) for controlling both display and light reception, so that the display device having a picture reading function is made miniaturized and compact.

BACKGROUND OF THE INVENTION

[0001] 1. Field of the Invention

[0002] The present invention relates to a device having an image sensorfunction and a display function, and particularly to an electronicequipment, such as an active matrix panel with a display portion made ofa pixel portion including a plurality of pixel electrodes disposed inmatrix, a portable terminal unit with such a display portion, or apersonal computer with such a display portion, and also to a method ofmanufacturing the same.

[0003] 2. Description of the Related Art

[0004] In recent years, a technique of a TFT using polycrystal siliconcalled a polysilicon TFT has been diligently investigated. As a result,it becomes possible to manufacture a driving circuit, such as a shiftregister, with polysilicon TFTs, and further, an active matrix typeliquid crystal panel in which a pixel portion and a peripheral drivingcircuit for driving the pixel portion are integrated on the samesubstrate, has been put to practical use. Thus, the cost of the liquidcrystal panel is lowered, the size thereof is reduced, the weightthereof is decreased, and the liquid crystal panel is used as a displayportion of various information equipments or portable equipments, suchas a personal computer, a portable telephone, a video camera, and adigital camera.

[0005] Recently, a pocket-sized small portable information processingterminal unit, which is superior in portability to a note-sized personalcomputer and is inexpensive, has been put to practical use, and anactive matrix type liquid crystal panel is used for its display portion.In such an information processing terminal,- although data can beinputted from the display portion by a touch-pen system, it is necessaryto connect the terminal with a peripheral device for reading an image,such as a scanner or a digital camera, in order to inputcharacter/drawing information on a paper or picture information. Forthis reason, the. portability of the information processing terminal ishindered. Also, an economical load for purchasing a peripheral device isimposed on a user.

[0006] An active matrix type display device is used also for a displayportion of a TV meeting system, a TV telephone, a terminal for theinternet, and the like. Although such a system or terminal is providedwith a camera (CCD camera) for photographing an image of a dialogist ora user, a display portion and a reading portion (sensor portion) areseparately manufactured and are modularized. Thus, the manufacturingcost becomes high.

SUMMARY OF THE INVENTION

[0007] An object of the present invention is to overcome the foregoingproblems, and to provide a display device using a novel semiconductordevice which includes a pixel matrix, an image sensor, and a peripheralcircuit for driving those, that is, includes both a camera function anda display function and is made intelligent.

[0008] Another object of the present invention is to inexpensivelymanufacture a display device using a novel semiconductor device which ismade intelligent by causing an image sensor to coordinate with a pixelmatrix and a peripheral driving circuit in the structure andmanufacturing process.

[0009] In order to achieve the above objects, in the present invention,such a structure is adopted that a semiconductor device for display anda semiconductor device for light reception are disposed on the samesubstrate. A liquid crystal display portion including a pixel electrodeand a semiconductor device for display, and a sensor portion including asemiconductor device for light reception are not separately disposed,but a novel device structure which includes the semiconductor device fordisplay and the semiconductor device for light reception in one pixel,that is, as shown in FIGS. 1 and 2, a structure which includessemiconductor devices (insulated gate field effect semiconductor device)for carrying out control of both display and light reception in onepixel, is adopted, so that a display device with a picture readingfunction is made small and compact.

[0010] According to a first aspect of the present invention, anintegral-type liquid crystal display panel with an image sensor functioncomprises a display portion made of a pixel matrix including at leastpixel electrodes in matrix and a first semiconductor device connected toeach of the pixel electrodes, and a sensor portion including at least aphotoelectric conversion element and a second semiconductor deviceconnected to the photoelectric conversion element, wherein the sensorportion is disposed on the same substrate as the display portion, andlight from a back surface of the substrate is received by the sensorportion.

[0011] According to a second aspect of the present invention, anintegral-type liquid crystal display panel with an image sensor functioncomprises a display portion made of a pixel matrix including at leastpixel electrodes in matrix and a first semiconductor device connected toeach of the pixel electrodes, and a sensor portion including at least aphotoelectric conversion element and a second semiconductor deviceconnected to the photoelectric conversion element, wherein the sensorportion is disposed on the same substrate as the display portion, thedisplay portion and the sensor portion have the same pixel size, andlight from a back surface of the substrate is received by the sensorportion.

[0012] According to a third aspect of the present invention, anintegral-type liquid crystal display panel with an image sensor functioncomprises a display portion made of a pixel matrix including at leastpixel electrodes in matrix and a first semiconductor device connected toeach of the pixel electrodes, and a sensor portion including aphotoelectric conversion element and a second semiconductor deviceconnected to the photoelectric conversion element, wherein the sensorportion is disposed on the same substrate as the display portion, thefirst semiconductor device and the second semiconductor device aredisposed in the same matrix, and the pixel electrode connected to thefirst semiconductor device exists over the second semiconductor device.

[0013] According to a fourth aspect of the present invention, anintegral-type liquid crystal display panel with an image sensor functioncomprises a display portion made of a pixel matrix including at leastpixel electrodes in matrix and a first semiconductor device connected toeach of the pixel electrodes, and a sensor portion including aphotoelectric conversion element and a second semiconductor deviceconnected to the photoelectric conversion element, wherein the sensorportion is disposed on the same substrate as the display portion; thephotoelectric conversion element includes at least an upper electrode, aphotoelectric conversion layer, and a lower electrode, the upperelectrode is made of a metal having reflectivity to at least visiblelight, and the lower electrode is made of a transparent conductive film.

[0014] According to a fifth aspect of the present invention, a method ofmanufacturing an integral-type liquid crystal display panel with animage sensor function which comprises a pixel matrix including pixelelectrodes disposed in matrix and a first semiconductor device connectedto each of the pixel electrodes, and an image sensor with a lightreceiving portion including a photoelectric conversion element and asecond semiconductor device connected to the photoelectric conversionelement, which are disposed on the same substrate as the pixel matrix,the method comprising: a first step of forming the first semiconductordevice and the second semiconductor device on the substrate; a secondstep of forming a lower electrode connected to the second semiconductordevice and made of a transparent conductive film; a third step offorming a photoelectric conversion layer on the lower electrode; and afourth step of forming an upper electrode contacting on thephotoelectric conversion layer.

[0015] According to a sixth aspect of the present invention, a method ofmanufacturing an integral-type liquid crystal display panel with animage sensor function which comprises a pixel matrix including pixelelectrodes disposed in matrix and a first semiconductor device connectedto each of the pixel electrodes, and an image sensor with a lightreceiving portion including a photoelectric conversion element and asecond semiconductor device connected to the photoelectric conversionelement, which are disposed on the same substrate as the pixel matrix,the method comprising: a first step of forming the first semiconductordevice and the second semiconductor device on the substrate; a secondstep of forming a first insulating film covering at least the firstsemiconductor device and the second semiconductor device; a third stepof forming a transparent conductive film on the first insulating film; afourth step of forming a lower electrode connected to the secondsemiconductor device by patterning the transparent conductive film; afifth step of forming a photoelectric conversion layer on the lowerelectrode; and a sixth step of forming an upper electrode contacting onthe photoelectric conversion layer.

[0016] According to a seventh aspect of the present invention, anintegral-type liquid crystal panel with an image sensor functioncomprises a photoelectric conversion element including a lowerelectrode, a photoelectric conversion layer formed on the lowerelectrode, and an upper electrode formed on the photoelectric conversionlayer; and a sensor portion including at least one active elementconnected to the photoelectric conversion element, the sensor portionbeing disposed on an insulating substrate, wherein the upper electrodeis made of a metal having reflectivity to at least visible light, andthe lower electrode is made of a conductive film having transparency toat least visible light.

[0017] According to an eighth aspect of the present invention, anintegral-type liquid crystal display panel with an image sensor functioncomprises a display portion made of a pixel matrix including at leastpixel electrodes in matrix and an active element connected to each ofthe pixel electrodes, and a sensor portion including at least aphotoelectric conversion element and an active element group connectedto the photoelectric conversion element, wherein the sensor portion isdisposed on the same substrate as the display portion, and light from aback surface of the substrate is received by the sensor portion.

[0018] According to a ninth aspect of the present invention, an integraltype liquid crystal display panel with an image sensor functioncomprises a display portion made of a pixel matrix including at leastpixel electrodes in matrix and an active element connected to each ofthe pixel electrodes, and a sensor portion including at least aphotoelectric conversion element and an active element group connectedto the photoelectric conversion element, wherein the sensor portion isdisposed on the same substrate as the display portion, the displayportion and the sensor portion have the same pixel size, and light froma back surface of the substrate is received by the sensor portion.

[0019] According to a tenth aspect of the present invention, anintegral-type liquid crystal display panel with an image sensor functioncomprises a display portion made of a pixel matrix including at leastpixel electrodes in matrix and an active element connected to each ofthe pixel electrodes, and a sensor portion including at least aphotoelectric conversion element and an active element group connectedto the photoelectric conversion element, wherein the sensor portion isdisposed on the same substrate as the display portion, the activeelement and the active element group are disposed in the same matrix,and the pixel electrode connected to the active element exists over theactive element group.

[0020] According to an eleventh aspect of the present invention, anintegral-type liquid crystal display panel with an image sensor functioncomprises a display portion made of a pixel matrix including at leastpixel electrodes in matrix and an active element-connected to each ofthe pixel electrodes, and a sensor portion including at least aphotoelectric conversion element and an active element group connectedto the photoelectric conversion element, wherein the sensor portion isdisposed on the same substrate as the display portion, the photoelectricconversion element includes at least an upper electrode, a photoelectricconversion layer, and a lower electrode, the upper electrode is made ofa metal having reflectivity to at least visible light, and the lowerelectrode is made of a transparent conductive film.

[0021] In the eighth to eleventh aspects of the present invention, theactive element group includes at least an amplification transistor, areset transistor, and a selection transistor.

[0022] According to a twelfth aspect of the present invention, a methodof manufacturing an integral-type liquid crystal display panel with animage sensor function which comprises a pixel matrix including pixelelectrodes disposed in matrix and an active element connected to each ofthe pixel electrodes, and an image sensor with a light receiving portionincluding a photoelectric conversion element and an active element groupconnected to the photoelectric conversion element, which are disposed onthe same substrate as the pixel matrix, the method comprising: a firststep of forming the active element and the active element group on thesubstrate; a second step of forming a lower electrode connected to theactive element group and made of a transparent conductive film; a thirdstep of forming a photoelectric conversion layer on the lower electrode;and a fourth step of forming an upper electrode on the photoelectricconversion layer.

[0023] According to a thirteenth aspect of the present invention, amethod of manufacturing an integral-type liquid crystal display panelwith an image sensor function which comprises a pixel matrix includingpixel electrodes disposed in matrix and an active element connected toeach of the pixel electrodes, and an image sensor including aphotoelectric conversion element and an active element group connectedto the photoelectric conversion element, which are disposed on the samesubstrate as the pixel matrix, the method comprising: a first step offorming the active element and the active element group on thesubstrate; a second step of forming a first insulating film covering atleast the active element and the active element group; a third step offorming a transparent conductive film on the first insulating film; afourth step of forming a lower electrode connected to the active elementgroup by patterning the transparent conductive film; a fifth step offorming a photoelectric conversion layer on the lower electrode; and asixth step of forming an upper electrode contacting on the photoelectricconversion layer.

[0024] In the twelfth aspect or thirteenth aspect of the presentinvention, the active element group includes at least an amplificationtransistor, a reset transistor, and a selection transistor.

BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In the accompanying drawings:

[0026]FIG. 1 is a sectional view of a pixel of the present invention;

[0027]FIGS. 2A and 2B are views showing an example of front surfacearrangement and back surface arrangement of one pixel;

[0028]FIG. 3 is a circuit diagram of the present invention.

[0029]FIGS. 4A and 4B are views of the entire of a liquid crystal panel;

[0030]FIGS. 5A to 5D are views showing steps of forming a sensor portionand a display element on one pixel;

[0031]FIGS. 6A to 6C are views showing steps of forming a sensor portionand a display element on one pixel;

[0032]FIG. 7 is a sectional view of a pixel of a second embodiment;

[0033]FIGS. 8A to 8D are views of manufacturing steps of the secondembodiment;

[0034]FIGS. 9A to 9C are views of manufacturing steps of the secondembodiment;

[0035]FIG. 10 is a circuit diagram of a third embodiment; and

[0036]FIGS. 11A to 11D show an applied examples of the presentinvention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0037] First, a typical mode using the present invention will bedescribed below. In the present invention, as shown in FIG. 1, such anovel element structure is adopted that one pixel includes onesemiconductor device (TFT) for display and at least one semiconductordevice (TFT) for light reception. A device is constructed such that apotential is applied to a liquid crystal oriented by an oriented filmformed on a reflective electrode of this element so that display is madeon a liquid crystal display surface, and a sensor portion reads a lightsignal incident on the back surface of the liquid crystal displaysurface so that a picture is taken in. The panel structure of thisinvention is shown in FIGS. 4A and 4b. FIG. 3 is a view showing acircuit diagram of the panel of the present invention simply.

[0038] As shown in FIG. 4A, a liquid crystal panel has such a panelarrangement that a sensor driving circuit 403 for driving a sensorportion and a display driving circuit 404 for driving a display portionare provided around a display portion and sensor portion 402.

[0039] In the present invention, such a system is adopted that thesensor portion reads light signal data incident on the back surface of aliquid crystal display surface, stores the data in an external storagedevice or the like connected to a sensor terminal portion 406, the dataare processed for picture display, and then, the data are inputted froma display lead terminal portion 405, so that a picture is displayed ontothe display portion 402. Such a structure may be adopted that a memorycircuit or the like is formed on the same substrate, so that thesesystems are carried out on the same substrate. Moving pictures or stillpictures taken in by the sensor portion are displayed on the liquidcrystal panel almost in realtime. Moreover, such a structure may beadopted that data from the outside of the device can be displayed on thedisplay portion.

[0040]FIG. 4B is a simplified view of a sectional structure taken alongline A-B in FIG. 4A. An element substrate 400 is bonded to an oppositesubstrate 401 through a seal material 407, and a liquid crystal material410 is held between the substrates. A picture is provided to a user byusing light incident on the liquid crystal display surface.

[0041] In the present invention, the sensor portion senses a lightsignal having passed through an optical system 409 attached to the backsurface, a color filter 411, and further the substrate 400. Thus, it ispreferable to use the substrate 400 having extremely excellenttransparency to visible light.

[0042]FIG. 1 is a sectional view of one pixel making up the displayportion and sensor portion 402 in FIG. 4, and FIGS. 2A and 2B are viewsshowing an example of an arrangement using such an element.

[0043]FIG. 2A indicates a surface top view and a sectional view takenalong A-B corresponds to FIG. 1. In FIG. 2A, the sensor portion iscovered with a reflective electrode 121. In FIG. 2A, such a structure isadopted that the reflective electrode 121 is not formed on wiring lines106, 107, 115 and 116. The liquid crystal display is made by using thisreflective electrode 121. Wiring lines concerned in the liquid crystaldisplay are the pixel portion TFT signal line 115 and the pixel portionTFT gate line 106.

[0044]FIG. 2B shows the back surface of FIG. 2A. Actually, sinceprotective shading (light shielding) films 104 and 105 for a TFT areformed, although a TFT portion can not be observed, for convenience,only forming portions of the shading films 104 and 105 are shown in thedrawing. In addition, although a photoelectric conversion layer 118 maybe formed on the wiring lines 106, 107, 115, and 116 and a pixel TFT,FIG. 2B shows a structure in which the photoelectric conversion layer118 is not formed. A light signal incident on the photoelectricconversion layer is read, and data are transmitted to the sensor portionTFT signal line 116. Here, wiring lines concerned in picture reading arethe sensor portion TFT signal line 116 and the sensor portion TFT gateline 107.

[0045] That is, as shown in FIG. 1 or FIGS. 2A and 2B, since the presentinvention is constructed such that one pixel includes two TFTs, thepitch of pixels and the number of bits become the same between the lightreceiving matrix and the display matrix. The shading film 104 isprovided on the substrate 100 at a display element side, so that such astructure is adopted that the TFT is protected against light incidentfrom the back surface. Moreover, such a structure may be adopted thatthe shading film 105 may be provided on the TFT at a sensor elementside. Moreover, such a structure may be adopted that the shading filmmay be directly provided on the back surface of the substrate.

[0046] After an under film 101 is formed on the shading films 104 and105, a plurality of TFTs for displaying or reading pictures are formed.The back surface of the substrate here indicates a substrate surface onwhich a TFT is not formed. The structure of the TFT may be a top gatetype or a bottom gate type.

[0047] Then a transparent conductive film 117 connected to a drainelectrode 112 of the TFT at the sensor element side is provided. Thisconductive film is a film forming a lower electrode of a photoelectricconversion element, and is formed on a pixel region other than the upperportion of the TFT of the display element. A photoelectric conversionlayer is provided on the conductive film, and an upper electrode 119 isfurther provided thereon, so that a photoelectric conversion element iscompleted.

[0048] On the other hand, with respect to the TFT at the display elementside, a pixel reflective electrode 121 connected to a drain wiring line114 is provided. Such a structure may be adopted that the pixelreflective electrode covers the sensor portion and a wiring line. In thecase where the structure of covering the wiring line is adopted,capacitance is formed with a dielectric of an insulating film existingbetween the wiring line and the pixel reflective electrode. Since thepresent invention relates to a reflection type display, a metal materialhaving reflectivity is used as the pixel electrode.

[0049] A manufacturing process of the present invention is substantiallythe same as manufacturing steps of a conventional display device exceptmanufacturing steps of a photoelectric conversion element. Thus, since aconventional manufacturing process can be used, the device can bemanufactured easily and at low cost. Moreover, even if a sensor functionis included, the shape and size of the device manufactured through thepresent invention are not changed from a conventional panel. Thus, itssize can be made small and its weight can made light.

[0050] Although the present invention will be described below in moredetail with respect to the preferred embodiments, it is needless to saythat the present invention is not limited to these embodiments.

EMBODIMENT 1

[0051] In this embodiment, an example of manufacturing steps of a liquidcrystal panel having a sensor portion receiving light from a backsurface of a liquid crystal display surface will be described in detailwith reference to FIGS. 5A to 5D and FIGS. 6A to 6C.

[0052] First, an under film 101 is formed on the entire surface of atransparent substrate 100. As the transparent substrate 100, a glasssubstrate or a quartz substrate having transparency may be used. As theunder film, a silicon oxide film with a thickness of 150 nm was formedby a plasma CVD method. In this embodiment, prior to this step offorming the under film, there were provided a shading film 104 forprotecting a display pixel portion TFT against light from the backsurface, and a shading film 104 for protecting a light receiving sensorportion TFT against light from the back surface. In this embodiment,although the shading films are provided to prevent noise anddeterioration, it is not particularly necessary to provide them if anopening rate is prioritized.

[0053] Next, an amorphous silicon film with a thickness of 30 to 100 nm,preferably 30 nm was formed by a plasma CVD method, and a polycrystalsilicon film was formed by irradiation of excimer laser light. As themethod of crystallizing the amorphous silicon film, a thermalcrystallizing method called an SPC, an RTA method using irradiation ofinfrared rays, a method of using thermal crystallization and laserannealing, and the like may be used.

[0054] Next, the polycrystal silicon film is patterned to form islandlike semiconductor layer 102 for making source regions, drain regions,channel formation regions of TFTs 200 and 300. Then a gate insulatingfilm 103 covering these semiconductor layers is formed. The gateinsulating film with a thickness of 100 nm is formed by a plasma CVDmethod using silane (SiH₄) and N₂O as a raw material gas (FIG. 5A).

[0055] Next, a conductive film is formed. Here, although aluminum wasused as a conductive film material, a film mainly containing titanium,silicon, or a lamination film of those films may be used. In thisembodiment, the aluminum film with a thickness of 200 to 500 nm,typically 300 nm is formed by a sputtering method. For the purpose ofsuppressing generation of hillocks or whiskers, scandium (Sc), titanium(Ti), or yttrium (Y) of 0.04 to 1.0 wt % is made to be contained in thealuminum film.

[0056] Next, a resist mask is formed, and the aluminum film is patternedto form an electrode pattern, so that a pixel gate electrode 106 and asensor portion gate electrode 107 are formed.

[0057] Next, an offset structure is formed by a well-known method.Further, an LDD structure may be formed by a well-known method (FIG.5B).

[0058] Then a first interlayer insulating film 113 is formed, andcontact holes reaching N-type high concentration impurity regions(source region, drain region) are formed. Thereafter, a metal film isformed and is patterned to form wiring lines 112, 114, 115, and 116.

[0059] In this embodiment, the first interlayer insulating film 113 isformed of a silicon nitride film with a thickness of 500 nm. As thefirst interlayer insulating film, a silicon oxide film or a siliconnitride oxide film may be used other than the silicon nitride film.Moreover, a multilayer film of these insulating films may be used.

[0060] As the metal film of a starting film of the wiring lines, in thisembodiment, a lamination film made of a titanium film, an aluminum film,and a titanium film is formed by a sputtering method. The thicknesses ofthese films are 100 nm, 300 nm, and 100 nm, respectively.

[0061] Through the foregoing process, the pixel TFT 200 and the lightreceiving portion TFT 300 are completed at the same time (FIG. 5C).

[0062] Next, a transparent conductive film being in contact with thedrain wiring line 112 of the light receiving portion TFT is formed onthe first interlayer insulating film 113. The transparent conductivefilm is formed and is patterned, so that a transparent electrode 117 ofa photoelectric conversion element is formed. ITO or SnO₂ may be usedfor the transparent conductive film 117. In this embodiment, an ITO filmwith a thickness of 100 nm is formed as the transparent conductive film.

[0063] While an upper electrode is formed of a transparent conductivefilm in a general active type image sensor, the image sensor of thisembodiment is different from the general image sensor in that a lowerelectrode is formed of the transparent conductive film. In thisinvention, since light is received from the back surface, the lowerelectrode is formed of the transparent conductive film (FIG. 5D).

[0064] Next, an amorphous silicon film 118 containing hydrogen(hereinafter referred to as a-Si:H film) functioning as a photoelectricconversion layer is formed on the entire surface of the substrate. Thenpatterning is carried out so that the a-Si:H film remains at only alight receiving portion to form the photoelectric conversion layer.

[0065] Next, a conductive film is formed on the entire surface of thesubstrate. In this embodiment, a titanium film with a thickness of 200nm is formed as the conductive film by a sputtering method. Thisconductive film is patterned to form an upper electrode 119 connected tothe light receiving portion TFT. Titanium or chromium may be used as theconductive film (FIG. 6A).

[0066] A light receiving effective portion of this sensor portion is aportion in one pixel, which is surrounded by the gate wiring lines 106and 107 and the signal wiring lines 115 and 116 and in which the shadingfilms 104 and 105 are not formed. The sizes of pixels in this embodimentare the same between the display portion and the sensor portion, and thesize is made 60×60 μm. However, the size is not particularly limited aslong as it is within the range of 16×16 μm to 70×70 μm.

[0067] Then a second interlayer insulating film 120 is formed. When aresin film of polyimide, polyamide, polyimide amide, acryl, or the likeis formed as an insulating film for forming the second interlayerinsulating film, a flat surface can be obtained, so that such a resinfilm is preferable. Alternatively, a lamination layer structure may beadopted such that an upper layer of the second interlayer insulatingfilm is the foregoing resin film, and a lower layer thereof is a singlelayer or multilayer film of inorganic insulating materials such assilicon oxide, silicon nitride, and silicon nitride oxide. In thisembodiment, a polyimide film with a thickness of 0.7 μm was formed asthe insulating film on the entire surface of the substrate (FIG. 6B).

[0068] Further, a contact hole reaching the drain wiring line 114 isformed in the second interlayer insulating film. A conductive film isagain formed on the entire surface of the substrate, and is patterned toform a pixel electrode 121 connected to the pixel TFT. In thisembodiment, a titanium film with a thickness of 200 nm is formed as theconductive film by a sputtering method. Titanium, chromium, or aluminummay be used for the conductive film.

[0069] Through the foregoing steps, an element substrate as shown inFIG. 6C or FIG. 1 is completed.

[0070] Then this element substrate and an opposite substrate are bondedto each other through a seal material, and a liquid crystal is enclosedso that a reflection type liquid crystal panel is completed. The liquidcrystal can be freely selected according to an operation mode (ECB mode,guest-host mode) of the liquid crystal. The opposite substrate isconstructed such that a transparent conductive film and an oriented filmare formed on a transparent substrate. Other than those, a black mask ora color filter may be provided as the need arises.

[0071] Subsequently, as shown in FIG. 4B, a color filter 411, an opticalsystem 409, and a support 408 for fixing the optical system 409 areprovided on the back surface of the liquid crystal panel, and the deviceis manufactured.

[0072] In this way, the liquid crystal panel having the sensor portionwhich receives light from the back surface of the liquid crystal displaysurface is completed. FIG. 3 is a circuit diagram of this embodimentsimplified into 2×2 pixels for convenience.

[0073] The most remarkable feature in this circuit diagram is that theliquid crystal display element and the sensor element are independent ofeach other.

[0074] The liquid crystal display element is mainly made up of a liquidcrystal material 302, a capacitance 314, a pixel TFT 303, a gate lineconnected to a display gate driver 311, a display signal driver 310, adisplay input signal line 306, and a fixed potential line 304.

[0075] The sensor element is mainly made of a photodiode PD 301, asensor TFT 312, an output signal line of a sensor, a sensor horizontalshift register 308, a sensor vertical shift register 309, and a fixedpotential line 305.

EMBODIMENT 2

[0076] In this embodiment, an example of manufacturing steps of a liquidcrystal panel including a sensor portion receiving light from a backsurface of a liquid crystal display surface will be described in detailwith reference to FIGS. 5A to 8D and FIGS. 9A to 9C.

[0077] The feature of this embodiment is that one pixel includes adisplay pixel portion TFT and a light receiving sensor portion TFT, aninterlayer insulating film covering these TFTs are formed, aphotoelectric conversion layer is formed on the interlayer insulatingfilm, and is connected to the light receiving sensor portion TFT. Thus,as compared with the embodiment 1, the opening rate is large.

[0078] First, an under film 701 is formed on the entire surface of atransparent substrate. A glass substrate or a quartz substrate may beused as a transparent substrate 700. A silicon oxide film with athickness of 200 nm was formed as the under film by a plasma CVD method.In this embodiment, prior to the step of forming the under film, ashading film 704 for protecting the display pixel TFT portion againstlight from the back surface, and a shading film 706 for protecting thelight receiving sensor TFT portion against light from the back surfacewere provided.

[0079] Next, an amorphous silicon film with a thickness of 30 to 100 nm,preferably, 30 nm was formed by a plasma CVD method, and a polycrystalsilicon film is formed by irradiation of excimer laser light. As themethod of crystallizing the amorphous silicon film, a thermalcrystallizing method called an SPC, an RTA method using irradiation ofinfrared rays, a method of using thermal crystallization and laserannealing, and the like may be used.

[0080] Next, the polycrystal silicon film is patterned to form islandlike semiconductor layers 702 for making source regions, drain regions,and channel formation regions of TFTs 800 and 900. Next, a gateinsulating film 703 covering these semiconductor layers is formed. Thegate insulating film with a thickness of 120 nm is formed by a plasmaCVD method using silane (SiH₄) and N₂O as a raw material gas (FIG. 8A).

[0081] Next, a conductive film is formed. Here, although aluminum wasused as a conductive film material, a film mainly containing titanium,silicon, or a lamination film of those films may be used. In thisembodiment, the aluminum film with a thickness of 300 to 500 nm,typically 300 nm is formed by a sputtering method. For the purpose ofsuppressing the generation of hillocks or whiskers, scandium (Sc),titanium (Ti), or yttrium (Y) of 0.04 to 1.0 wt % is made to becontained in the aluminum film.

[0082] Next, a resist mask is formed, and the aluminum film is patternedto form an electrode pattern, so that gate electrodes 705 and 707 areformed.

[0083] Next, LDD structures 709 and 710 are formed by a well-knownmethod. Besides, an offset structure may be formed by a well-knownmethod. Reference numerals 708 and 711 denote high concentrationimpurity regions, and 712 denotes a channel region (FIG. 8B).

[0084] Then a first interlayer insulating film 713 is formed, andcontact holes reaching N-type high concentration impurity regions(source region, drain region) are formed. Thereafter, a metal film isformed and is patterned to form wiring lines 714, 715, 722, and 723.

[0085] In this embodiment, the first interlayer insulating film isformed of a silicon nitride film with a thickness of 500 nm. As thefirst interlayer insulating film, a silicon oxide film or a siliconnitride film may be used other than the silicon nitride oxide film.Moreover, a multilayer film of these insulating films may be used.

[0086] As the metal film of a starting film of the wiring electrodes714, 715, 722, and 723, in this embodiment, a lamination film made of atitanium film, an aluminum film, and a titanium film is formed by asputtering method. The thicknesses of these films are 100 nm, 300 nm,and 100 nm, respectively.

[0087] Through the foregoing process, the pixel TFT 800 and the lightreceiving portion TFT 900 are completed at the same time (FIG. 8C).

[0088] Next, a second interlayer insulating film 716 covering the TFTsis formed. The main point different from the embodiment 1 is that thissecond interlayer insulating film is provided so that a photoelectricconversion layer formed in a subsequent step can be widely formed. Bydoing so, a light receiving area (opening rate) of a sensor can be madewider than the embodiment 1. A resin film which cancels asperities of alower layer so that a flat surface can be obtained, is preferable as thesecond interlayer insulating film. As such a resin film, polyimide,polyamide, polyimide amide, or acryl may be used. Alternatively, anupper layer of the second interlayer insulating film may be theforegoing resin film for the purpose of obtaining the flat surface, anda lower layer thereof may be a single layer or a multilayer of inorganicinsulating material such as silicon oxide, silicon nitride, and siliconnitride oxide. In this embodiment, a polyimide film with a thickness of1.5 μm is formed as the second interlayer insulating film.

[0089] Next, after a contact hole reaching the wiring line 723 of thelight receiving portion TFT 900 is formed in the second interlayerinsulating film 716, a transparent conductive film is formed. As thetransparent conductive film, ITO or SnO₂ may be used. In thisembodiment, an ITO film with a thickness of 120 nm is formed.

[0090] Next, the transparent conductive film is patterned to form alower electrode 717 connected to the light receiving portion TFT 900(FIG. 8D).

[0091] Next, an amorphous silicon film 718 containing hydrogen(hereinafter referred to as a-Si:H film) functioning as a photoelectricconversion layer is formed on the entire surface of the substrate. Thenpatterning is carried out so that the a-Si:H film remains at only alight receiving portion to form the photoelectric conversion layer.

[0092] Next, a conductive film is formed on the entire surface of thesubstrate. In this embodiment, a titanium film with a thickness of 200nm is formed as the conductive film by a sputtering method. Thisconductive film is patterned to form an upper electrode 719 connected tothe light receiving portion TFT. Titanium or chromium may be used forthe conductive film.

[0093] While an upper electrode in a general active type image sensor isformed of a transparent electrode, the image sensor of this embodimentis different from the general image sensor in that a lower electrodethereof is formed of a transparent electrode. In this invention, sincelight is received from the back surface, the lower electrode is formedof a transparent conductive film (FIG. 9A).

[0094] Then a third interlayer insulating film 720 is formed. If a resinfilm of polyimide, polyamide, polyimide amide, or acryl is used as aninsulating film forming the third interlayer insulating film, a flatsurface can be obtained, so that such a resin film is preferable.Alternatively, an upper layer of the third interlayer insulating filmmay be the foregoing resin film and a lower layer thereof may be asingle layer or multilayer film of inorganic insulating material such assilicon oxide, silicon nitride, and silicon nitride oxide. In thisembodiment, a polyimide film with a thickness of 0.5 μm was formed onthe entire surface of the substrate (FIG. 9B).

[0095] The maximum process temperature of the present invention afterthe formation of the polyimide film is made a temperature lower than theheat resistance temperature 320° C. of this polyimide.

[0096] Further, a contact hole reaching the wiring line is formed in thethird and second interlayer insulating films. A conductive film is againformed on the entire surface of the substrate, and is patterned to forma pixel electrode 721 connected to the pixel TFT. In this embodiment, atitanium film with a thickness of 200 nm is formed as the conductivefilm by a sputtering method. Titanium or chromium may be used for theconductive film.

[0097] Through the foregoing steps, an element substrate as shown inFIG. 9C or FIG. 7 is completed.

[0098] Thereafter, similarly to the embodiment 1, the element substrateand an opposite substrate are bonded to each other through a sealmaterial, and a liquid crystal is enclosed to complete a reflection typeliquid crystal panel. A color filter 411, an optical system 409, and asupport 408 for fixing the optical system 409 are provided on the backsurface of the liquid crystal panel, and the device is manufactured.

[0099] In this way, the liquid crystal panel including the sensorportion receiving light from the back surface of the liquid crystaldisplay surface is completed.

EMBODIMENT 3

[0100] Although examples in which a non-amplifying image sensor is used,are shown in the embodiments 1 and 2, this embodiment relates to anamplifying type image sensor. More specifically, an example in which animage sensor including semiconductor devices disposed in matrix, will bedescribed.

[0101]FIG. 10 is a simplified view of a circuit diagram of a liquidcrystal panel using this amplifying type image sensor. The amplifyingtype image sensor uses three TFTs of a reset transistor T₁, anamplification transistor T₂, and a selection transistor T₃. The mostremarkable feature in this circuit diagram is that this diagram includesa reset line 1012, a power source line 1113, a sensor verticalperipheral driving circuit 1009, a sensor horizontal peripheral drivingcircuit 1008, and a fixed potential line 1115.

[0102] Moreover, similarly to the embodiment 1 or 2, the feature of thisembodiment is that the wiring line of the liquid crystal display elementand the wiring line of the sensor element is independent of each other.The liquid crystal display element is made up of a liquid crystal 1002,a pixel TFT 1003, a capacitance 1114, a fixed potential line 1004, agate line connected to a display gate driver 1011, a display signaldriver 1010, and a display input signal line 1006.

[0103] While an upper electrode of a general active type image sensor isformed of a transparent electrode, the image sensor of this embodimentis different from the general image sensor in that a lower electrodethereof is formed of a transparent electrode.

[0104] With respect to the operation method of the image sensor of thisembodiment, when a picture of one frame is detected, a reset pulsesignal is inputted from the reset line 1012, and the reset transistor T₁with a gate connected to the reset line is turned on. Then the potentialof an upper electrode of a photodiode and an amplification transistor isreset to a power source potential. When the reset transistor T, is in anoff state, the gate electrode of the amplification transistor T₂ is putin a floating state. In this state, light incident on the photo diode PD1001 is converted into an electric charge and is stored. By thiselectric charge, the potential of the upper electrode of the photodiodeis slightly changed from the power source potential. The change of thispotential is detected as a potential variation of the gate electrode ofthe amplification transistor T₂, and a drain current of theamplification transistor T₂ is amplified. When a selection pulse signalis inputted from a selection line 1116 is inputted, the selectiontransistor T₃ is turned on, and an electric current amplified by theamplification transistor T₂ is outputted as a picture signal to a signalline 1007.

EMBODIMENT 4

[0105] In this embodiment, an example of a device provided with anintegral-type liquid crystal display panel having an image sensorfunction as described in the embodiments 1 to 3 will be described.

[0106] Here, a digital still camera as shown in FIGS. 11A and 11B willbe described. FIGS. 11A and 11B show cases in which angles of viewingare different from each other by 180 degrees.

[0107] The structure shown in FIGS. 11A and 11B includes a main body1101, a display portion 1106, a light receiving portion 1102 which isdisposed on the back surface of the main body and in which an imagesensor is disposed, an operation switch 1105, a shutter 1104, and astroboscopic lamp 1103.

[0108] An image sensed by the image sensor of the light receivingportion 1102 is subjected to signal processing, and a still picture or amoving picture is displayed in realtime or is taken in a memory.

[0109] Moreover, here, a portable telephone having a sensor function asshown in FIGS. 11C and 11D will be described. FIGS. 11C and 11D showcases in which viewing angles are different from each other by 180degrees.

[0110] The structure shown in FIGS. 11C and 11D includes a main body1111, a display portion 1117, a light receiving portion 1112 which isdisposed on the back surface of the main body and in which an imagesensor is disposed, and an operation switch.

[0111] An image sensed by the image sensor of the light receivingportion 1112 is subjected to signal processing, and a still picture or amoving picture is displayed by the display portion 1117 in realtime.Also picture data are received from a communicating partner and aredisplayed. Further, such a structure may be adopted that picture datasensed by the image sensor of the light receiving portion 1112 are takenin the memory and are transmitted to a communicating partner.

[0112] The manufacturing process of the present invention is the same asthat of a conventional display device other than the manufacturing stepsof the photoelectric conversion element. Thus, since a conventionalmanufacturing process can be used, the device can be easily andinexpensively manufactured. Further, even if a sensor function isincluded, the shape and size of the substrate of the device manufacturedby the present invention are not changed from a conventional panel.Thus, the size of the device can be made small and the weight thereofcan be made light.

[0113] Moreover, since a light receiving area of a sensor cell issubstantially the same as a pixel area of a display cell, and is largeas compared with a single crystal CCD, the sensor of the presentinvention can be made supersensitive. Further, electric power consumedin this structure is small, and electric power consumed in the imagesensor can also be made small as compared with a CCD structure.

What is claimed is:
 1. An integral-type liquid crystal display panelwith an image sensor function, comprising: a display portion made of apixel matrix including at least pixel electrodes in matrix and a firstsemiconductor device connected to each of the pixel electrodes; and asensor portion including at least a photoelectric conversion element anda second semiconductor device connected to the photoelectric conversionelement, which are disposed on a same substrate as the display portion,wherein light from a back surface of the substrate is received by thesensor portion.
 2. An integral-type liquid crystal display panel with animage sensor function, comprising: a display portion made of a pixelmatrix including at least pixel electrodes in matrix and a firstsemiconductor device connected to each of the pixel electrodes; and asensor portion including at least a photoelectric conversion element anda second semiconductor device connected to the photoelectric conversionelement, which are disposed as the same substrate as the displayportion, wherein the display portion and the sensor portion have a samepixel size; and light from a back surface of the substrate is receivedby the sensor portion.
 3. An integral-type liquid crystal display panelwith an image sensor function, comprising: a display portion made of apixel matrix including at least pixel electrodes in matrix and a firstsemiconductor device connected to each of the pixel electrodes; and asensor portion including at least a photoelectric conversion element anda second semiconductor device connected to the photoelectric conversionelement, which are disposed on a same substrate as the display portion,wherein the first semiconductor device and the second semiconductordevice are provided in a same matrix; and the pixel electrode connectedto the first semiconductor device exists over the second semiconductordevice.
 4. An integral-type liquid crystal display panel with an imagesensor function, comprising: a display portion made of a pixel matrixincluding at least pixel electrodes in matrix and a first semiconductordevice connected to each of the pixel electrodes; and a sensor portionincluding at least a photoelectric conversion element and a secondsemiconductor device connected to the photoelectric conversion element,which are disposed on a same substrate as the display portion, whereinthe photoelectric conversion element includes at least an upperelectrode, a photoelectric conversion layer, and a lower electrode; theupper electrode is made of a metal having reflectivity to at leastvisible light; and the lower electrode is made of a transparentconductive film.
 5. A method of manufacturing an integral-type liquidcrystal display panel with an image sensor function which comprises apixel matrix including pixel electrodes disposed in matrix and a firstsemiconductor device connected to each of the pixel electrodes, and animage sensor with a light receiving portion including a photoelectricconversion element and a second semiconductor device connected to thephotoelectric conversion element, the image sensor being disposed on thesame substrate as the pixel matrix, and the method comprising: a firststep of forming the first semiconductor device and the secondsemiconductor device on the substrate; a second step of forming a lowerelectrode connected to the second semiconductor device and made of atransparent conductive film; a third step of forming a photoelectricconversion layer on the lower electrode; and a fourth step of forming anupper electrode contacting on the photoelectric conversion layer.
 6. Amethod of manufacturing an integral-type liquid crystal display panelwith an image sensor function which comprises a pixel matrix includingpixel electrodes disposed in matrix and a first semiconductor deviceconnected to each of the pixel electrodes, and an image sensor with alight receiving portion including a photoelectric conversion element anda second semiconductor device connected to the photoelectric conversionelement, which are disposed on the same substrate as the pixel matrix,and the method comprising: a first step of forming the firstsemiconductor device and the second semiconductor device on thesubstrate; a second step of forming a first insulating film covering atleast the first semiconductor device and the second semiconductordevice; a third step of forming a transparent conductive film on thefirst insulating film; a fourth step of forming a lower electrodeconnected to the second semiconductor device by patterning thetransparent conductive film; a fifth step of forming a photoelectricconversion layer on the lower electrode; and a sixth step of forming anupper electrode contacting on the photoelectric conversion layer.
 7. Anintegral-type liquid crystal panel, comprising: a photoelectricconversion element including a lower electrode, a photoelectricconversion layer disposed on the lower electrode, and an upper electrodedisposed on the photoelectric conversion layer; and a sensor portionincluding at least one active element connected to the photoelectricconversion element and being disposed on an insulating substrate;wherein: the upper electrode is made of a metal having reflectivity toat least visible light; and the lower electrode is made of a conductivefilm having transparency to at least visible light.
 8. An integral-typeliquid crystal display panel with an image sensor function, comprising:a display portion made of a pixel matrix including at least pixelelectrodes in matrix and an active element connected to each of thepixel electrodes; and a sensor portion including at least aphotoelectric conversion element and an active element group connectedto each of the photoelectric conversion element, the sensor portionbeing disposed on a same substrate as the display portion, wherein lightfrom a back surface of the substrate is received by the sensor portion.9. An integral-type liquid crystal display panel with an image sensorfunction, comprising: a display portion made of a pixel matrix includingat least pixel electrodes in matrix and an active element connected toeach of the pixel electrodes; and a sensor portion including at least aphotoelectric conversion element and an active element group connectedto the photoelectric conversion element, which are disposed on a samesubstrate as the display portion, wherein: the display portion and thesensor portion have a same pixel size; and light from a back surface ofthe substrate is received by the sensor portion.
 10. An integral-typeliquid crystal display panel with an image sensor function, comprising:a display portion made of a pixel matrix including at least pixelelectrodes in matrix and an active element connected to each of thepixel electrodes; and a sensor portion including a photoelectricconversion element and an active element group connected to thephotoelectric conversion element, which are disposed on a same substrateas the display portion, wherein: the active element and the activeelement group are provided in a same matrix; and the pixel electrodeconnected to the active element exists over the active element group.11. An integral-type liquid crystal display panel with an image sensorfunction, comprising: a display portion made of a pixel matrix includingat least pixel electrodes in matrix and an active element connected toeach of the pixel electrodes; and a sensor portion including at least aphotoelectric conversion element and an active element group connectedto the photoelectric conversion element, which are disposed on a samesubstrate as the display portion; wherein: the photoelectric conversionelement includes at least an upper electrode, a photoelectric conversionlayer, and a lower electrode; the upper electrode is made of a metalhaving reflectivity to at least visible light; and the lower electrodeis made of a transparent conductive film.
 12. An integral-type liquidcrystal display panel with an image sensor function according to any oneof claims 8 to 11 , wherein the active element group includes at leastan amplification transistor, a reset transistor, and a selectiontransistor.
 13. A method of manufacturing an integral-type liquidcrystal display panel with an image sensor function which comprises apixel matrix including pixel electrodes disposed in matrix and an activeelement group connected to the pixel electrodes, and an image sensorwith a light receiving portion including a photoelectric conversionelement and an active element group connected to the photoelectricconversion element, the image sensor being disposed on the samesubstrate as the pixel matrix, and the method comprising: a first stepof forming the active element and the active element group on thesubstrate; a second step of forming a lower electrode connected to theactive element group and made of a -transparent conductive film; a thirdstep of forming a photoelectric conversion layer on the lower electrode;and a fourth step of forming an upper electrode contacting on thephotoelectric conversion layer.
 14. A method of manufacturing anintegral-type liquid crystal display panel with an image sensor functionwhich comprises a pixel matrix including pixel electrodes disposed inmatrix and an active element connected to each of the pixel electrodes,and an image sensor with a light receiving portion including aphotoelectric conversion element and an active element group connectedto the photoelectric conversion element, the image sensor being disposedon the same substrate as the pixel matrix, and the method comprising: afirst step of forming the active element and the active element group onthe substrate; a second step of forming a first insulating film coveringat least the active element and the active element group; a third stepof forming a transparent conductive film on the first insulating film; afourth step of forming a lower electrode connected to the active elementgroup by patterning the transparent conductive film; a fifth step offorming a photoelectric conversion layer on the lower electrode; and asixth step of forming an upper electrode contacting on the photoelectricconversion layer.
 15. A method of manufacturing an integral-type liquidcrystal display panel with an image sensor function according to claim13 or 14 , wherein the active element group includes at least anamplification transistor, a reset transistor, and a selectiontransistor.